IN THE CLAIMS 



1 . (Currently Amended) A method comprising: 

creating a multimedia annotation for a paper document, the multimedia annotation 
representing at least one of an audio sound and a video clip; and 

creating a first multimedia document by combining the paper document and the 

multimedia annotation represented by a first bar code encoding the at least one of 
the audio sound and video clip , such that th e multim e dia annotation can b e 
e xtract e d and d e cod e d subs e qu e ntly from th e first multim e dia docum e nt and 
play e d via a multim e dia play e r , 

wherein the first multimedia document is generated as a part of reproducing the paper 
document via a document reproduction system , and 

wherein the first multimedia document, which when scanned by a process, the process 
causes the printed multimedia annotation to be decoded, the at least one of the 
audio sound and video clip to be extracted from the multimedia annotation, and 
the at least one extracted audio sound and video clip can be played via a 
multimedia player , 

2. (Canceled) 

3. (Canceled) 
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4. (Previously Presented) The method of claim 1, wherein a location indicator 
associated with the multimedia annotation is placed on the first multimedia document, 
wherein the location indicator indicates where the multimedia annotation can be retrieved and 
played. 

5. (Previously Presented) The method of claim 4, wherein the location indicator 
comprises a first Uniform Resource Locator (URL), and a second bar code, wherein the first 
URL is indicated in plain text, and wherein the second bar code represents the first URL in an 
encrypted form. 

6. (Canceled) 

7. (Canceled) 

8. (Currently Amended) The method of claim 1, further comprising: 

generating an image of the paper document, the image of the paper document being 
unconsciously captured via the document reproduction system during the 
reproduction of the paper document without user intervention; 

creating a second multimedia document by combining the image of the paper 

document and the multimedia annotation, wherein the multimedia annotation is 
captured via an input device of the document reproduction system while the 
paper document is being reproduced via the document reproduction system; and 
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storing the image of the paper document and the multimedia annotation in a storage^ 
wherein the second multimedia document is an electronic document associated 
with the first multimedia document which is a physical document . 

9. (Previously Presented) The method of claim 8, wherein the second multimedia 
document is represented as a second Uniform Resource Locator (URL) printed on the first 
multimedia document, and wherein the image of the paper document and the multimedia 
annotation is accessed with the second URL. 

10. (Original) The method of claim 9, wherein a third bar code is used to represent the 
second URL. 

1 1 . (Previously Presented) The method of claim 8, further comprising automatically 
sending the second multimedia document to a recipient by electronic mail as a part of 
reproducing the paper document via the document reproduction system, wherein the recipient 
is specified by a user via an interface of the document reproduction system when the user 
reproduces the paper document using the document reproduction system. 

12. (Original) The method of claim 11, wherein the recipient receives the image of the 
paper document and the multimedia annotation in the form of Multi-purpose Internet Mail 
Extension (MIME). 
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13. (Currently Amended) A machine-readable medium providing instructions, which 
when executed by a set of one or more processors, cause said set of processors to perform the 
following: 

creating a multimedia annotation for a paper document, the multimedia annotation 
representing at lest one of an audio sound and a video clip; and 

creating a first multimedia document by combining the paper document and the 

multimedia annotation represented by a first bar code encoding the at least one 
of the audio sound and video clip , such that th e multim e dia annotation can b e 
e xtract e d and d e cod e d subs e qu e ntly from th e first multim e dia docum e nt and 
play e d via a_multim e dia play e r , 

wherein the first multimedia document is generated as a part of reproducing the paper 
document via a document reproduction system , and 

wherein the first multimedia document, which when scanned by a process, the process 
causes the printed multimedia annotation to be decoded, the at least one of the 
audio sound and video clip to be extracted from the multimedia annotation, and 
the at least one extracted audio sound and video clip can be played via a 
multimedia player . 

14. (Canceled) 

15. (Canceled) 

16. (Previously Presented) The machine-readable medium of claim 13, wherein a 
location indicator associated with the multimedia annotation is placed on the first multimedia 
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document, wherein the location indicator indicates where the multimedia annotation can be 
retrieved and played. 

17. (Previously Presented) The machine-readable medium of claim 16, wherein the 
location indicator comprises a first Uniform Resource Locator (URL), and a second bar code, 
wherein the first URL is indicated in plain text, and wherein the second bar code represents 
the first URL in an encrypted form. 

18. (Canceled) 

19. (Canceled) 

20. (Currently Amended) The machine-readable medium of claim 13, further comprising: 
generating an image of the paper document, the image of the paper document being 

unconsciously captured via the document reproduction system during the 
reproduction of the paper document without user intervention; 
creating a second multimedia document by combining the image of the paper 

document and the multimedia annotation, wherein the multimedia annotation is 
captured via an input device of the document reproduction system while the 
paper document is being reproduced via the document reproduction system; 
and 

storing the image of the paper document and the multimedia annotation in a storage^ 
wherein the second multimedia document is an electronic document associated 
with the first multimedia document which is a physical document . 
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21 . (Previously Presented) The machine-readable medium of claim 20, wherein the 
second multimedia document is represented as a second Uniform Resource Locator (URL) 
printed on the first multimedia document, and wherein the image of the paper document and 
the multimedia annotation is accessed with the second URL. 

22. (Original) The machine-readable medium of claim 21, wherein a third bar code is 
used to represent the second URL. 

23. (Previously Presented) The machine-readable medium of claim 20, further 
comprising automatically sending the second multimedia document to a recipient by 
electronic mail as a part of reproducing the paper document via the document reproduction 
system, wherein the recipient is specified by a user via an interface of the document 
reproduction system when the user reproduces the paper document using the document 
reproduction system. 

24. (Original) The machine-readable medium of claim 23, wherein the recipient receives 
the image of the paper document and the multimedia annotation in the form of Multi-purpose 
Internet Mail Extension (MIME). 

25. (Currently Amended) A computer system, comprising: 
a bus; 

a data storage device coupled to the bus; and 

a processor coupled to the data storage device, the processor operable to receive 
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instructions which, when executed by the processor, cause the processor to 
perform a method comprising 

creating a multimedia annotation for a paper document, the multimedia 

annotation representing at least one of an audio sound and a video clip; 
and 

creating a first multimedia document by combining the paper document and the 
multimedia annotation represented by a first bar code encoding the at 
least one of the audio sound and video clip , such that th e multim e dia 
annotation can be e xtract e d and d e coded subs e qu e ntly from th e first 
multim e dia docum e nt and play e d via a multim e dia play e r , 

wherein the first multimedia document is generated as a part of reproducing the 
paper document via a document reproduction system , and 

wherein the first multimedia document, which when scanned by a process, the 
process causes the printed multimedia annotation to be decoded, the at 
least one of the audio sound and video clip to be extracted from the 
multimedia annotation, and the at least one extracted audio sound and 
video clip can be played via a multimedia player . 

26. (Canceled) 

27. (Canceled) 

28. (Previously Presented) The computer system of claim 25, wherein a location 
indicator associated with the multimedia annotation is placed on the first multimedia 
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document, wherein the location indicator indicates where the multimedia annotation can be 
retrieved and played. 

29. (Previously Presented) The computer system of claim 28, wherein the address 
comprises a first Uniform Resource Locator (URL), and a second bar code, wherein the first 
URL is indicated in plain text, and wherein the second bar code represents the first URL in an 
encrypted form. 

30. (Canceled) 

31. (Canceled) 

32. (Currently Amended) The computer system of claim 25, further comprising: 
generating an image of the paper document, the image of the paper document being 

unconsciously captured via the document reproduction system during the 
reproduction of the paper document without user intervention; 
creating a second multimedia document by combining the image of the paper 

document and the multimedia annotation, wherein the multimedia annotation is 
captured via an input device of the document reproduction system while the 
paper document is being reproduced via the document reproduction system; 
and 

storing the image of the paper document and the multimedia annotation in a storage^ 
wherein the second multimedia document is an electronic document associated 



with the first multimedia document which is a physical document . 
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33. (Previously Presented) The computer system of claim 32, wherein the second 
multimedia document is represented as a second Uniform Resource Locator (URL) on the first 
multimedia document, and wherein the image of the paper document and the multimedia 
annotation is accessed with the second URL. 

34. (Original) The computer system of claim 33, wherein a third bar code is used to 
represent the second URL. 

35. (Previously Presented) The computer system of claim 32, further comprising 
automatically sending the second multimedia document to a recipient by electronic mail as a 
part of reproducing the paper document via the document reproduction system, wherein the 
recipient is specified by a user via an interface of the document reproduction system when the 
user reproduces the paper document using the document reproduction system. 

36. (Original) The computer system of claim 35, wherein the recipient receives the image 
of the paper document and the multimedia annotation in the form of Multi-purpose Internet 
Mail Extension (MIME). 

37. -43. (Canceled) 

44. (Currently Amended) The method of claim 3J_, wherein the first multimedia 
document is a physical document having the first bar code printed thereon, wh e r e in which 
when scanned by a scanning device, causes the audio sound can b e e xtract e d from the 
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multim e dia document by scanning and d e cod e d th e first bar code to be decoded and the audio 
sound to be extracted from the first bar code, and wherein the extracted audio sound is capable 
of being played via an audio player. 

45. (Previously Presented) The method of claim 8, further comprising capturing an audio 
sound of the multimedia annotation from a user using a microphone of the input device when 
the user reproduces the paper document using the document reproduction system. 

46. (Previously Presented) The method of claim 45, wherein the microphone is 
automatically activated when the user selects a reproduction function of the document 
reproduction system to reproduce the paper document. 

47. (Previously Presented) The method of claim 8, further comprising capturing a video 
clip of the multimedia annotation from a user using a video camera of the input device when 
the user reproduces the paper document using the document reproduction system. 

48. (Previously Presented) The method of claim 47, wherein the video camera is 
automatically activated when the user selects a reproduction function of the document 
reproduction system to reproduce the paper document. 

49. (Previously Presented) The method of claim 8, further comprising, in response to a 
request to retrieve the second multimedia document, performing a content-based search for 
the requested multimedia document within the storage based on content of the multimedia 
annotation associated with the requested multimedia document. 
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50. (Previously Presented) The method of claim 49, wherein the content-based search is 
performed via an optical character recognition (OCR) process on the multimedia annotation of 
the multimedia documents being searched. 

51 . (Previously Presented) The method of claim 49, wherein the content-based search is 
performed via a speech recognition mechanism on an audio sound of the multimedia 
annotation of the multimedia documents being searched. 

52. (Previously Presented) The method of claim 49, wherein the content-based search is 
performed on a video clip of the multimedia annotation based on an image of the user using 
face recognition techniques. 
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